-
Notifications
You must be signed in to change notification settings - Fork 476
feat: added a check for gc code to run #3419
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
ACTION NEEDED delta-rs follows the Conventional Commits specification for release automation. The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just two nits, otherwise we are good to go! :)
Thanks for picking this up
let generated_col_expressions = this | ||
.snapshot | ||
.as_ref() | ||
.map(|v| v.schema().get_generated_columns().unwrap_or_default()) | ||
.unwrap_or_default(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You can do snapshot.schema() now since you already checked existence :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ahh thank you for the catch!
let (source, missing_generated_columns) = | ||
add_missing_generated_columns(source.clone(), &generated_col_expressions)?; | ||
|
||
source_with_gc = Some(source); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
small nit, but we can do same as you did in the write mod, just use a mut source
@JustinRush80 is it ready? |
Yes I believe so should I be concerned about the failed coverage check? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Think Ion got most of it
No it got broken since we added the |
d3ff34b
to
dac4a70
Compare
Signed-off-by: JustinRush80 <[email protected]>
Head branch was pushed to by a user without write access
dac4a70
to
4ecc06c
Compare
Description
Add a validation check that only runs if generated columns feature is enabled in the tablefeatures or writer version 5 is enabled
Related Issue(s)
Documentation